Limitations of PET-PEESE and other meta-analysis methods

A novel meta-regression method, PET-PEESE, predicts and explains recent high-profile failures to replicate in psychology. The central purpose of this paper is to identify the limitations of PETPEESE for application to social/personality psychology. Using typical conditions found in social/personality research, our simulations identify three areas of concern. PET-PEESE performs poorly in research areas where: there are only a few studies, all studies use small samples, and where there is very high heterogeneity of results from study to study. Nonetheless, the statistical properties of conventional meta-analysis approaches are much worse than PETPEESE under these same conditions. Our simulations suggest alterations to conventional research practice and ways to moderate PET-PEESE weaknesses.